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Abstract 

•'V  - 

The  pocket-size  liquid  crystal  television  (LCTV)  has  been  investigated  for  Its  potential 
as  a  two  dimensional  spatial  light  modulator.  The  LCTV  can  be  addressed  using  both  a 
microcomputer  and  a  TV  camera.  He  have  measured  various  characteristics  of  this  device 
including  transmission  control,  bipolar  modulation  capabilities,  and  have  tested  Its  usage 
as  an  Input  device  for  an  optical  correlator.  Optical  phase  distortions  of  the  device  can 
be  compensated  by  a  liquid  gate.  These  results  suggest  that  this  device  has  great  potential 
for  optical  pattern  recognition  and  optical  data  processing  applications.  . 

A - 

Introduction 


Optical  data  processing  and  optical  pattern  recognition  are  mainly  limited  by  the  capa¬ 
bility  and  availability  of  real-time  two-dimensional  spatial  light  modulators  (SLM's). 

Among  the  many  types  of  SLM's  which  have  been  developed  are  the  liquid  crystal  light  valve 
(LCLV)I  ,  the  magneto-optic  spatial  light  modulator  ,  the  mlcrochannel  spatial  light-mod- 
ulator  ,  the  Pockels  readout  optical  modulator  ,  and  the  deformable  mirror  device 
However,  these  SLM's  are  very  expensive  or  are  still  in  R  A  D  stages.  Recently  however, 
several  versions  of  a  small  inexpensive  compact  liquid  crystal  television  (LCTV)  have 
become  commercially  available.  He  have  Investigated  the  properties  of  one  of  these  for 
optical  data  processing  applications. 

The  Radio  Shack  LCTV  (Realistic  Pocketvislon  Cat.  No.  16-151  or  16-153)  has  a  5.4  cm 
by  4.4  cm  screen.  The  unit  consists  of  a  two-dimensional  grid  of  raster-scanned  liquid 
crystal  cells,  each  of  which  Is  capable  of  modulating  coherent  or  incoherent  light  trans¬ 
mitted  through  It.  The  LCTV  which  we  Investigated  has  a  resolution  of  146  horizontal 
elements  by  120  vertical  elements.  Each  unit  cell  Is  370  urn  x  370  urn  square.  The  LCTV 
comes  equipped  with  a  video  input  Jack  which  allows  an  Image  to  be  written  electronically 
with  a  microcomputer  or  with  a  TV  camera. 

Experimental  Results 

For  most  of  our  experiments,  we  used  the  computer  Input  mode.  Using  an  Apple  II  micro¬ 
computer,  the  high  resolution  screen  with  2 80  horizontal  by  192  vertical  pixels  addresses 
ill  horizontal  by  96  vertical  cells  on  the  LCTV  screen.  Therefore,  there  is  a  2/1  match  of 
vertical  elements  allowing  exact  registration.  However,  the  horizontal  registration  is 
Inexact  causing  edge  blurring. 

A  commercial  television  camera  was  also  used  to  provide  an  Input  scene  and  gray  scale 
operation  was  verified  by  changing  the  F-stop  on  the  camera. 

Each  cell  of  the  LCTV  screen  Is  a  90*  twisted  nematic  liquid  crystal  sandwiched  between 
parallel  polarizers.  When  no  electric  field  Is  applied,  the  plane  of  polarization  for 
linearly  polarized  light  Incident  on  the  cell  Is  rotated  through  90*  by  the  twisted  liquid 
crystal  molecules  and  no  light  Is  transmitted  through  the  second  polarizer.  However,  under 
an  applied  electric  field,  the  twist  and  tilt  of  the  liquid  crystal  molecules  are  altered 
affecting  the  rotation  angle  of  the  transmitted  light  and  therefore  varying  the  amount  of 
light  transmitted  through  the  second  polarizer. 

Voltage  is  applied  to  each  pixel  through  horizontal  and  vertical  line  electrodes  which 
Intersect  at  each  pixel.  The  voltage  applied  to  each  pixel  Is  determined  by  two  factors. 
First,  an  adjustable  BRIGHTNESS  control  adjusts  a  uniform  voltage  onto  every  pixel  which 
allows  the  transmission  level  of  the  entire  screen  to  be  uniformly  varied.  In  addition, 
the  Input  signal  from  the  TV  receiver,  the  computer,  or  the  TV  camera  then  varies  the 
Individual  voltage  applied  to  each  pixel,  thus  modulating  the  individual  transmission  of 
each  pixel  and  creating  the  picture. 
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Experiments  studying  the  polarization  of  the  light  transmitted  by  the  liquid  crystal 
cells  were  performed  after  the  second  polarizer  was  removed  from  the  LCTV.  The  transmitted 
polarization  state  was  analyzed  with  a  second  rotatable  polarizer  as  a  function  of  bias 
voltage  across  the  LCTV  at  the  He-Ne  laser  wavelength  of  632.8  nm.  Control  of  this  voltage 
was  provided  by  the  brightness  adjustment.  In  order  to  obtain  an  arbitrary  yet  quantitative 
measurement  of  this  voltage,  we  took  the  LCTV  apart  and  measured  the  voltage  drop  across 
the  variable  resistor  which  controls  the  brightness.  This  resistor  is  designated  RV801 
on  the  circuit  schematic  given  In  the  REALISTIC  service  manual.  The  laser  beam  was  expanded 
to  cover  a  large  number  of  pixels. 

These  experiments  showed  that  the  plane  of  polarization  transmitted  through  the  liquid 
crystal  elements  was  essentially  linear  and  rotated  as  the  brightness  control  voltage  was 
varied  as  shown  In  Figure  1.  The  two  curves  show  the  results  when  the  computer  monitor  was 
addressing  every  pixel  (termed  the  On  state)  and  when  the  computer  monitor  was  turned  off. 
The  two  curves  essentially  differ  by  a  rotation  angle  of  11*.  Note  that  the  Initial  rota¬ 
tion  angle  with  no  applied  voltage  (corresponding  to  -1.7  V)  was  only  73*  and  not  the 
expected  90*.  We  feel  that  this  Indicates  that  the  Initial  polarizer  was  not  accurately 
aligned  with  the  direction  of  the  liquid  crystal  molecules.  The  output  polarization  was 
essentially  linear  with  a  slight  orthogonal  component  which  is  also  probably  due  to  this 
misalignment.  Therefore,  the  device  operates  very  similarly  to  the  LCLV  and  the  magneto- 
optic  SLM.  The  transmitted  light  Intensity  will  then  vary  as  the  computer  voltage  is 
changed.  However,  the  exact  nature  of  the  transmitted  light  will  depend  on  the  angle  of 
the  second  polarizer  as  well  as  the  brightness  control  voltage. 

Previous  Investigations  of  the  LCTV*  have  shown  that  there  is  a  phase  nonuniformity  across 
the  surface  which  destroys  much  of  its  capability  as  a  SLM.  This  was  examined  next  by 
studying  the  Fraunhofer  diffraction  pattern  produced  by  the  device.  Light  from  the  He-Ne 
laser  was  collimated  and  sent  through  a  36.8  cm  focal  length  lens.  A  diode  array  detector 
placed  in  the  focal  plane  of  the  lens  was  used  to  record  the  Fraunhofer  diffraction  pattern. 
Figure  2A  shows  the  focused  spot  produced  by  the  system.  Figure  2B  shows  the  broadening  of 
the  focused  spot  when  the  LCTV  was  introduced  into  the  system.  This  broadening  is  evidence 
of  phase  nonuniformlty  across  the  plane  of  the  LCTV. 

These  phase  variations  were  correctable  by  placing  the  LCTV  inside  a  Newport  Corporation 
model  550-G  liquid  gate  filled  with  mineral  oil.  This  successfully  eliminated  the  phase 
variations  as  shown  by  the  sharpened  focused  spot  in  Figure  2C.  The  liquid  gate  Is  used  in 
the  remainder  of  these  experiments. 

We  next  explored  the  use  of  this  device  as.a  bipolar  modulator  which  has  previously  been 
demonstrated  for  the  Litton  magireto-optlc  SLM'.  As  discussed  earlier,  light  transmitted  by 
the  LCTV  has  two  polarization  states  which  are  rotated  by  a  maximum  of  ii*  to  each  other 
depending  on  the  state  of  each  pixel.  The  transmitted  light  intensity  then  depends  on  the 
orientation  of  the  second  polarizer.  Results  of  varying  the  angle  of  this  second  polarizer 
were  examined  In  the  Fraunhofer  diffraction  of  a  pattern  placed  on  the  LCTV. 

A  grid  pattern  was  written  with  every  other  horizontal  line  of  the  LCTV  addressed  by  the 
microcomputer.  Recall  the  exact  registration  between  the  computer  output  and  the  TV  screen 
which  allows  this.  The  orientation  of  the  second  polarizer  was  adjusted  to  completely 
block  the  transmitted  light  from  the  pixels  which  were  not  addressed  resulting  in  the  trans¬ 
mission  pattern  as  shown  In  Figure  3A.  The  Fraunhofer  diffraction  pattern  will  consist  of 
a  high  DC  peak  with  first  order  peaks  whose  intensities  are  A/ir*  smaller  than  the  DC  peak 
as  shown  In  Figure  3B. 

Bipolar  operation  of  the  LCTV  can  be  achieved  by  orienting  the  second  linear  polarizer 
perpendicular  to  the  bisector  of  the  two  transmitted  polarization  states  as  shown  in  Figure 
A A .  Therefore  the  electric  field  passed  by  the  pixels  will  only  differ  by  a  phase  term  of 
i>  radians  resulting  in  the  electric  field  amplitude  transmission  pattern  of  Figure  AB.  The 
Fraunhofer  diffraction  pattern  for  this  will  have  no  DC  component.  The  orientation  of  the 
analyzer  was  adjusted  to  achieve  the  transmission  pattern  of  Figure  AB  and  results  are 
shown  in  Figure  AC.  We  see  a  dramatic  reduction  In  the  size  or  the  DC  peak  relative  to 
Figure  3B.  Although  the  size  of  the  DC  term  Is  greatly  reduced,  there  is  still  some  DC 
transmission.  There  are  several  possible  explanations  for  this.  First,  we  observe  that  the 
pattern  on  the  LCTV  is  not  uniform  possibly  due  to  a  voltage  nonuniformity  across  the  face 
of  the  screen.  Second,  there  are  areas  between  the  individual  pixels  which  are  not  affected 
by  the  applied  voltage.  Finally,  each  pixel  Is  sequentially  addressed  and  there  is  a  time 
lag  between  the  addressing  of  each  pixel  during  which  the  orientation  of  the  liquid  crystal 
molecules  can  relax  to  their  original  positions.  Therefore  the  transmission  state  of  each 
pixel  will  vary  slightly  with  time  contributing  to  a  DC  term.  Nevertheless,  this  capability 
for  bipolar  modulation  Is  Identical  to  that  recently  reported  for  the  magneto-optic  SLM'. 

A  series  of  measurements  were  then  made  using  the  LCTV  as  the  input  screen  for  a  Vender 
Lugt  optical  correlator  .  The  correlation  system  geometry  is  shown  In  Figure  5.  Collimated 
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light  from  *  spatially  filtered  beam  Is  Incident  on  plane  Pi  where  the  input  pattern  Is 
placed  using  the  LCTV.  The  Fourier  transform  plane  P2  Is  obtained  using  a  75  cm  focal 
length  lens.  The  reference  bean  was  also  spatially  filtered  and  colllaated  and  then  focused 
using  a  long  focal  lens  to  plane  P3  located  beyond  plane  P2.  This  converging  reference 
bean  Is  used  to  elinlnate  the  final  Fourier  transforn  lens  ¥,»0.  Hatched  spatial  niters 
(MSF)  were  then  recorded  using  a  Newport  Corporation  nodel  HC-300  thermoplastic  recording 
camera.  The  focused  reference  beam  synthesises  a  Fresnel  zone  plate  within  the  HSF.  Care 
was  taken  In  recording  the  MSF  to  emphasize  the  spatial  frequencies  corresponding  to  the 
grating  Information  shown  In  Figure  4B  and  not  the  grid  Information.  The  MSF  was  made  using 
the  grid  pattern  with  every  other  horizontal  line  of  the  LCTV  turned  on  as  before. 

Plane  P3  contains  the  correlation  between  the  input  pattern  and  the  pattern  used  in 
recording  the  MSF  agd  Is  shown  In  Figure  6.  This  correlation  spike  is  much  sharper  than 
previously  reported0,  again  due  to  the  liquid  gate.  Note  also  the  sideband  spikes  corres¬ 
ponding  to  the  correlation  of  the  pattern.with  a  shifted  version  of  Itself.  The  size  of 
the  correlation  spike  decreased  as  before0  as  the  period  of  the  input  pattern  varied  both 
above  and  below  the  period  used  in  making  the  MSF.  As  before,  the  correlation  spike  dis¬ 
appeared  when  the  LCTV  was  made  uniformly  transparent  of  the  LCTV  elements,  then  the  spike 
would  have  been  still  evident. 

Preliminary  experiments  using  the  TV  camera  to  address  the  LCTV  have  shown  translation 
Invariance  of  the  correlation  spike  and  will  be  reported  in  more  detail  In  the  future. 

Conclusions 


In  conclusion,  our  experiments  show  that  the  LCTV  can  be  used  as  a  highly  versatile  SLM. 
It  most  closely  matches  the  operational  characteristics  of  the  Litton  magneto-optic  SLM  in 
terms  of  resolution  and  operation  Including  the  capability  for  bipolar  modulation.  Although 
phase  nonuniformity  is  still  a  problem,  It  appears  that  it  can  be  corrected  using  the  liquid 
gate.  Moreover,  It  is  very  Inexpensive,  is  easily  connected  to  computers,  and  satisfies 
many  of  the  prerequisites  for  SLM's.  Finally,  it  will  allow  many  experimentalists  to  enter 
the  field  of  optical  pattern  recognition  at  substantially  reduced  expenses  and  may  prove  to 
be  an  Impetus  to  an  explosion  of  activity  in  this  field. 

This  research  is  partially  supported  by  NASA  and  partially  by  the  Physics  Division  of 
the  Army  Research  Office  through  contract  with  the  Jet  Propulsion  Laboratory.  We  wish  to 
acknowledge  the  expert  technical  assistance  of  M.  Hatay  of  S.D.S.U. 
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Figure  i . 
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Rotation  angle  of  light  transmitted  by  LCTV  cells 
versus  brightness  control  voltage.  Curves  show  data 
for  screen  when  computer  addresses  each  pixel  (dark 
triangles),  and  when  computer  turns  each  pixel  off 
(open  triangles). 
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Figure  3B.  Fraunhofer  diffraction  pattern  for  on-off  grid  in 
Figure  3B.  Horizontal  scale  Is  1 .6  mm. 
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- ANALYZER  POLARIZER 

Figure  4  A .  Orientation  of  analyzer  polarizer  to  achieve  bipolar 
modulation. 


Figure  AB.  Transmission  versus  position  for  bipolar  modulation 
grid  pattern. 
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Figure  5. 


Optical  correlator  geometry  used  in  making  matched  spatial 
filters  and  observing  correlation  signals. 
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Figure  6.  Cross  correlation  pattern  due  to  MSF  of  ruling  pattern  on 
LCTV  screen  addressed  by  Identical  LCTV  pattern. 
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The  potential  at  the  extremely  hupadw  Radio  Shock  liquid -cryetal  telewtioa  (LCTV)  ee  e  two-dim  wninnel 
apetiel  light  modulator  hee  been  ioteatigeted  The  LCTV  modnletee  the  trenemimioB  at  coherent  or  ineohenag 
light  and  can  either  be  electronically  eddreaaed  through  ■  microcomputer  or  opticelly  eddreeeert  with  e  TV  cemera. 
We  hare  maeeurad  the  ♦tawwlmiiui  charact erietka  at  the  device,  f  mined  ite  diffraction  pattern.  and  teated  Ha  urn 
aa  an  input  device  for  an  optical  correlator.  Wa  have  diacovared  that,  with  proper  modification*,  it  haa  potential  for 
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It  is  well  known  that  optical  data  proceosing  and  opti¬ 
cal  computing  are  limited  mainly  by  the  capability  and 
availability  of  real-tune  devices,  such  as  two-dimen¬ 
sional  spatial  light  modulators  (SIMM's).  For  this  rea¬ 
son,  great  efforts  by  many  researchers  have  been  spent 
in  search  for  usable  SIMM’s.  Rrieting  and  developing 
SLM*s  include  the  liquid-crystal  light  valve,1  the  mag¬ 
neto-optic  «p»R«i  light  modulator,*  tlx  miawli«idi«l 
spatial  light  modulator,1  the  Pockeb  readout  optical 
modulator,4  and  the  deformable  mirror  device.* 

Many  SLM*a  are  either  forbiddingly  expenaive  or 
are  atill  in  RAD  stages.  Recently,  several  small  inex¬ 
pensive  compact  liquid-crystal  televisions  (LCTV’s) 
became  commercially  avaibdde.  Ws  have  investigat¬ 
ed  the  properties  of  the  Radio  Shack  LCTV  for  opti- 
cal-deta-proreeeing  applications,  and  wfaat  follows  is  s 
brief  account  of  our  discoveries. 

The  LCTV  has  a  5.4-cm  by  4.4-cm  screen.  The  unit 
consists  of  a  two-dimensional  mosaic  of  raster- 
scanned  liquid-crystal  cells,  each  of  which  is  capable  of 
modulating  the  coherent  or  incoherent  light  transmit¬ 
ted  through  H.  The  resolution  of  the  LCTV  is  deter¬ 
mined  by  the  number  of  cells  in  the  screen.  The 
LCTV  under  investigation  has  146  horizontal  ele¬ 
ments  by  120  vertical  elements.  Each  unit  cell  is  370 
pm  X  370  pm  square.  The  LCTV  is  equipped  with  s 
video  input  Jack,  which  allows  an  image  to  be  written 
electronically  with  a  microcomputer  or  optically  with  a 
TV camera. 

For  meat  of  our  experiments,  we  have  used  the  com¬ 
puter  input  mode.  When  an  Apple  11+  microcom¬ 
puter  is  used,  the  high-reeolutkm  screen  with  280  hori¬ 
zontal  X 192  vertical  pixels  addresses  111  horizontal  X 
96  vertical  elements  of  the  LCTV.  Therefore,  there  is 
a  2  to  1  match  of  vertical  elements,  permitting  exact 
registration.  However,  the  horizontal  registration  is 
off,  causing  edge  blurring. 

A  TV  camera  was  also  used  to  provide  an  input 


scene,  and  gray-scale  operation  was  verified  fay  chang¬ 
ing  the  /-stop  on  the  camera. 

Each  liquid-crystal  cell  of  the  TV  screen  is  a  90* 
twisted  nematic  liquid  crystal  sandwiched  between 
parallel  polarizers.  When  no  electric  field  is  applied, 
the  plane  of  polarization  for  linearly  polarized  light  is 
rotated  through  90*  by  the  twisted  liquid-crystal  mol¬ 
ecules,  and  no  light  is  transmitted  through  the  second 
polarizer. 

However,  under  an  applied  electric  field,  the  twist 
and  the  tih  of  the  liquid-crystal  molecules  are  altered, 
resulting  in  a  greater  fraction  of  the  light  retaining  the 
initial  polarization  direction.  Aa  the  electric  field  ie 
increased  further,  the  molecules  do  not  affect  the 
plane  of  polarization,  and  all  the  light  passes  through 
the  second  polarizer.  Transmission  losses  are  then 
limited  to  the  transmission  of  two  polarizer  sheets. 

Voltage  is  applied  to  each  pixel  through  horizontal 
and  vertical  line  electrodes,  which  intersect  at  each 
pixel  The  voltage  applied  to  each  pixel  is  determined 
by  two  factors.  First,  a  brightness  control  determines 
a  hiss  voltage  scroes  every  cell  that  allows  the  trans¬ 
mission  level  of  the  entire  screen  to  be  varied.  The 
input  signal  from  the  TV  receiver,  the  computer,  or 
the  TV  camera  than  varies  the  individual  voltage  ap¬ 
plied  to  each  cell  modulating  the  individual  transmis¬ 
sion  of  each  call,  thus  cresting  a  SLM  with  gray-scale 
capability. 

We  have  performed  a  series  of  experiments  on  the 
LCTV.  Measurements  have  been  made  of  the  optical 
transmission  at  the  He-Ne  laser  wavelength  as  a  func¬ 
tion  of  hiss  voltage  across  the  liquid-crystal  unit  calls. 
Control  of  this  voltage  is  provided  by  the  brightness 
adjustment  on  the  LCTV.  In  order  to  obtain  a  quanti¬ 
tative  measurement,  we  took  the  LCTV  apart  and 
measured  the  voltage  drop  across  the  variable  resistor 
controlled  by  the  brightness  controL  (The  voltage 
across  a  call  is  not  directly  accessible.)  The  laser 


0146-9692/85/120636-0382.00/0  0  1986,  Optical  Society  of  America 


«3C  OPTICS  I.H'ITHKS  /  V,  0.  No.  12  /  Ikfflilw  19B& 


Fig.  1.  Transmission  measurements  of  the  LCTV  as  a  func¬ 
tion  of  bias  voltage.  Curve  A  shows  results  with  the  comput¬ 
er  pixels  turned  off;  curve  B  shows  results  with  the  computer 
pixels  turned  on. 


beam  was  expanded  to  cover  a  1-cm2  area  of  the  LCTV 
screen  to  average  over  a  large  number  of  pixels.  The 
percentage  transmission  versus  voltage  is  shown  as 
curve  A  of  Fig.  1.  The  maximum  transmission  obtain¬ 
able  is  50%,  and  the  full  contrast  is  about  25/1. 

Next,  the  transmission  was  measured  as  the  com¬ 
puter  wrote  uniformly  on  the  LCTV.  The  computer 
output  places  an  additional  voltage  on  each  cell,  mod¬ 
ulating  its  transmission  with  results  shown  as  curve  B 
of  Fig.  1.  The  computer  voltage  has  the  effect  of 
shifting  curve  A  by  about  —0.4V.  Therefore  the  oper¬ 
ation  of  the  LCTV  using  a  computer  input  consists  of 
picking  a  bias  point,  using  the  brightness  control,  and 
then  having  the  computer  change  the  bias  voltage  and 
the  resulting  transmission  at  any  pixel. 

Maximum  contrast  is  obtained  by  biasing  the 
brightness  control  at  -0.4  V.  The  high  slope  of  the 
trsnsmisaion-versus-voltage  curve  ensures  that  the 
computer  will  cause  a  maximum  change  in  transmis¬ 
sion.  In  many  SLM  applications,  it  is  important  to 
turn  all  unused  unit  cells  off,  and  the  preferred  bias 
point  is  at  —  L2  V.  However,  when  the  pixels  are 
turned  on,  the  transmission  increases  only  to  5%,  with 
the  contrast  significantly  decreased.  This  change  in 
the  voltage  applied  to  each  unit  cell  is  set  by  the  TV 
circuitry.  Attempts  to  increase  this  voltage  swing  for 
higher  contrast  were  unsuccessful  These  included 
varyLig  the  video  gain  and  the  snalog-to-digital  con¬ 
verter  adjustment  inside  the  TV  and  externally  ampli¬ 
fying  the  rf  signal  from  the  computer.  Therefore, 
without  extensive  modification,  computer  operation 
of  the  LCTV  can  provide  only  minimal  binary  trans¬ 
mission. 

Measurements  also  have  been  made  of  the  Fraun¬ 
hofer  diffraction  pattern  for  light  incident  upon  the 
LCTV;  they  are  shown  in  Fig.  2  (a).  As  expected  from 
theoretical  predictions,  the  prominent  pattern  is  rep¬ 
resentative  of  the  grid-matrix  type  of  cell  structure  of 
the  LCTV  elements.  Figure  2(b)  shows  the  results 
when  a  horizontal  grating  is  written  on  the  LCTV 
screen  with  every  other  line  turned  on.  The  expected 
additional  diffraction  spots  are  clearly  visible. 

Finally,  series  of  measurements  have  been  made 
using  the  LCTV  as  the  input  screen  for  a  Vander  Lugt 
optical  correlator.*  The  correlation  system  geometry 
is  shown  in  Fig.  3.  Collimated  light  from  a  spatially 
filtered  beam  is  incident  upon  plane  Pi,  where  the 


input  pattern  is  placed  using  the  LCTV.  The  Fourier 
transform  plane  P2  is  obtained  using  a  75-cm  focal- 
length  lens.  The  reference  beam  was  also  spatially 
filtered  and  collimated  and  then  focused  using  a  long- 
focal-length  lens  to  plane  P3  located  beyond  plane  P2. 
This  converging  reference  beam  is  used  to  eliminate 
the  final  Fourier-transform  lens.74  Matched  spatial 
filters  (MSF’a)  were  recorded  using  a  Newport  Corpo¬ 
ration  Model  HC-300  thermoplastic  recording  camera. 
The  focused  reference  beam  synthesizes  a  Fresnel 
zone  plate  within  the  MSF.  Care  was  taken  in  record¬ 
ing  the  MSF  to  emphasize  the  spatial  frequencies  cor¬ 
responding  to  the  grating  information  shown  in  Fig.  2(b) 
and  not  the  grid  information  shown  in  Fig.  2(a).  The 
MSF  was  made  using  a  computer-generaied  Ronchi 
ruling  having  a  period  of  10  pixel  lines  on  the  high- 
resolution  computer  screen. 

Plane  P3  contains  the  correlation  between  the  input 
pattern  and  the  pattern  used  in  the  recording  of  the 
MSF.  When  different  computer-generated  Ronchi 
ruling  patterns  appeared  on  the  LCTV,  the  correlation 
spikes  were  measured  using  a  diode  array;  results  are 
shown  in  Fig.  4.  Figure  4(a)  shows  the  output  when 
the  input  Ronchi  ruling  pattern  is  identical  to  that 
used  in  making  the  MSF.  The  correlation  spike  is 
clearly  seen.  Figure  4(b)  shows  the  results  when  a 
computer-generated  Ronchi  ruling  pattern  having  a 
period  of  24  lines  was  fed  to  the  LCTV.  The  correla¬ 
tion  spike  is  reduced,  as  expected. 

The  size  of  the  correlation  spike  decreased  as  the 
period  of  the  input  ruling  varied  about  the  period  used 


Fig.  2.  Fraunhofer  diffraction  patterns  from  the  LCTV: 
(a)  without  (b)  with  a  horizontal  grating  written  onto  the 
screen. 


Fig.  3.  Schematic  of  a  laser  MSF  recording  and  detection 
system. 
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Fig.  4.  Croea-correlation  signals  due  to  a  MSF  of  a  10-line 
ruling  pattern  on  the  LCTV  screen  addressed  by  (a)  10  lines, 
(b)  24  lines,  (c)  a  blank  screen.  Hie  vertical  axes  are  of  the 
same  scale  with  arbitrary  units.  The  horizontal  axis  has  a 
total  width  of  3.2  mm  (“128  jim  X  25  pm). 


in  making  the  MSF.  Our  success  in  optimizing  the 
MSF  is  shown  in  Fig.  4(c),  with  the  LCTV  screen 
uniformly  transparent  where  the  correlation  spike  is 
almost  gone.  If  the  MSF  were  optimized  for  the  spa¬ 
tial  frequencies  corresponding  to  the  two-dimensional 
grid  information  rather  than  to  the  ruling  information, 
the  spike  would  still  have  bean  evident 

In  conclusion,  our  experiments  show  that  the  LCTV 
can  be  used  as  a  SLM.  It  allows  data  to  be  input  easily 
to  the  LCTV  screen  from  either  a  microcomputer  or  a 
TV  camera.  The  contrast  ia  good  when  the  brightness 
control  is  adjusted  to  midrange.  However,  if  mini¬ 
mum  transmission  is  desired  for  various  unit  cells, 
then  the  maximum  transmission  is  limited  to  about 
8%.  This  transmission  characteristic  compares  well 
with  that  of  the  Litton  magneto-optical  SLM3  and 
should  be  improvable  with  changes  in  the  internal 
electronic  circuits  of  the  LCTV. 

At  the  present  stage,  only  relatively  coarse  objects 
can  be  used  ss  inputs  for  a  real-time  correlator  because 


of  limitations  in  the  resolution  and  space-bandwidth 
product  of  the  LCTV.  Nevertheless,  TV  frame-rate 
correlation  on  an  input  image  at  a  fixed  location  can  be 
implemented.  No  shift  invariance  was  observed.  This 
is  due  to  phase  nonuniformity  of  the  LCTV,  which  was 
discovered  by  us  working  with  Psaltis’s  group  at  the 
California  Institute  of  Technology  campus  and  also 
pointed  out  by  one  of  the  reviewers  of  the  manuscript 
of  this  Letter.  However,  the  LCTV  correlator,  after 
further  improvements  and  modifications,  should  be 
useful  to  robotic  vision  and  space  automation  pro¬ 
grams  at  NASA  and  in  industry.  It  is  also  worthwhile 
mentioning  that  the  low  price  and  versatility  of  the 
LCTV  SLM  make  it  attractive  for  optical-image-pro¬ 
cessing  pedagogical  applications. 

We  are  currently  investigating  other  applications 
for  this  LCTV,  including  bipolar  modulation,9  optical 
subtraction,10  high-gamma  nonlinear-optical  image 
processing,  and  optical  division  applications.11 

The  research  described  in  this  Letter  was  sponsored 
by  the  Physics  Division  of  the  UJS.  Army  Research 
Office  and  the  National  Aeronautics  and  Space  Ad¬ 
ministration.  The  LCTV  was  first  called  to  the  atten¬ 
tion  of  one  of  us  (H.K.  Liu)  by  J.G.Duthie.  We  thank 
M>  Brownell  and  P.  Dickinson  for  assisting  in  some  of 
the  measurements  and  M.  Hatay  for  helping  to  disas¬ 
semble  the  LCTV. 
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Abstract 

This  paper  describes  ho«  the  standard  MicroChannel  spatial  light  modulator  can  be  (a)  operated 
aad  (b)  modified  to  generate  a  real-time,  high-gamma  readout  characteristic  The  paper  alto 
examines  the  use  of  such  a  device  in  a  pa  lie -frequency  modulation  optical  processor  to  achieve 
a  wide  range  of  real-time,  nonlinear  image  aad  signal  processing  operations  such  as  histogram 
measurement,  density  slicing,  density-bated  artificial  stereo  and  gray  level  i stage  enhancement 


INTRODUCTION 


It  b  well  known  that  coding  and  modulation 
techniques  are  the  key  to  the  realisation  of  a  large 
number  of  two-dimensional,  nonlinear  image  process¬ 
ing  operations.  The  commonly  used  techniques  in¬ 
clude  linear  modulation  of  an  image  using  Ronchi 
rulings*  or  sinusoidal  gratings.*  aad  spatial  pulse- 
width  modulation  by  contact  screens.*  In  nonlinear 
processing,  operations  such  as  logarithmic  trans¬ 
formation,4**  exponents  tioa,*  •*  level  slicing,*'* 
multiple  isophotc  generation/'*  quantization,** 

pseudocolor.**  A-D  conversion,*  •**  subtraction,**** 
aad  multiple  image  storage*  can  be  realised.  Other 
coding  aad  modulation  techniques  include  optical 
pulas-frcqucacy  modulation  aad  pulse-azimuth 
modulation.1 4  A  one-dimensional  optical  pulse- 
frequency  modulation  technique,  for  example,  has 
been  used  in  conjunction  with  the  variable-grating* 
mode  liquid  crystal  light  valve*  *  to  demonstrate 
real-time  level  slicing. 

Unfortunately,  the  lack  of  a  high-resolution, 
high-gamma  spatial  light  modulator  that  would 
replace  photographic  film  has  precluded  widespread 
uaa  of  real-time  nonlinear  optical  processing.  The 
microchaoacl  spatial  light  atodulator  (MSLM)1****  is 
a  device  that  is  capable  of  achieving  very  high 
gamma,  la  this  paper  we  describe  how  the  standard 
MSLM  can  be  (a)  operated  aad  (b)  aeodified  (Fabry- 
Ferot  MSLM)  to  generate  a  real-time,  high-gamma 
readout  characteristic.  The  paper  also  eaamlnes  the 
•*  **ch  a  device  in  a  pulse -frequency  modulation 
optical  processor  to  achieve  a  wide  range  of  real¬ 
time,  nonlinear  image  aad  signal  processing  opera¬ 
tions  such  as  histogram  amasuremeat,*  *  density 
slicing.**  density-based  artificial  stereo,*4  aad 
gray  level  image  enhancement.*  * 


HIGH-GAMMA  CHARACTERISTIC 


The  desired  high-gamau  characteristic  for 
nonlinear  optical  processing  is  illustrated  in  Fig. 
I.  It  is  a  plot  of  log  l/T  vs  log  E_,  aad  it 
eshibits  a  sharp  threshold  exposure,  E.w.  Here  T 

is  the  modulator  readout  transmittance  aad  E_  is  the 
modulator  iaput  exposure  with  a  threshold  of 
For  this  negative-gamma  characteristic,  the  readout 
light  restates  in  the  ON  state  for  input  exposures 


below  threshold  and  is  switched  off  for  input  levels 
above  threshold.  The  gamma  7  of  the  system  is  the 
slope  of  the  linear  region  of  this  curve.  That  is, 

7  is  given  by 

F  •  log(T1/TJ)/log(^/El)  ( l) 

Both  the  standard  and  the  Fabry-Perot  MSLMs  are 
capable  of  high-gamaaa  operation,  and  both  positive', 
aad  negative  gamma  characteristics  can  be  achieved. 
The  techniques  by  which  the  gamata  of  an  MSLM  can  be 
increased  include  (I)  operation  of  the  device  in  the 
•onlinanr  hard-dipped  thresholding  mode,  (2) 
employing  optical  feedback  around  the  device,  aad 
(3)  converting  the  device  to  a  Fabry-Perot  MSLM. 
The  Fabry  Ferot  MSLM  inherently  generates  a  high- 
gaatasa  characteristic  when  operated  in  the  grid- 
stabilized  saturation  aaode. 


MICROCHANNEL  SFATIAL  LIGHT  MODULATORS 
Standard  MSLM 

The  standard  MicroChannel  Spatisl  Light  Modula¬ 
tor  (MSLM)1  *  '* 1  is  a  versatile,  real-time  optical 
signal  and  image  processing  device  that  exhibits 
high  optical  sensitivity  sad  high  framing  speed.  It 
consists  of  a  photocathode,  a  MicroChannel  plate 


(4) 


4  -> 


(MCP),  a  planar  acceleration  grid  and  nn  electro* 
optic  crystal  plate,  arranged  in  tlie  proximity 
focused  configuration  shown  in  Fig.  2.  The 
electro-optic  plate  carries  a  high  resistivity 
dielectric  mirror  on  one  tide  and  a  transparent 
conducting  electrode  on  the  other. 


Fig.  2.  The  optically  addressed  microchanaei  spatial 
light  modulator 


la  the  electron  deposition  write  mode,  incoherent 
or  coherent  write  light  iacideat  oa  the  photocathode 
creates  an  electron  image  which  is  amplified  by  the 
MCF  and  proximity  focused  onto  the  dielectric  mirror 
surface.  The  resulting  spatially  varying  electric 

field  in  the  crystal  modulates  the  refractive  index 
of  the  crystal.  Thus,  the  readout  light  which  makes 
a  double  pass  through  the  crystal  is  spatially  phase 
or  amplitude  modulated  depcadiag  oa  the  crystal  cut 
and  readout  schema  (polarization  or  interferometric) 
employed.  The  image  is  erased  by  appropriately 
adjusting  the  device  voltages  and  flooding  the 

photocathode  with  light  oa  that  electrons  are 
removed  from  the  mirror  surface  by  secondary 
electron  emission. 

Alternatively,  the  device  can  be  operated  in  the 
reverse  mode  where  a  positive-charge  image  is 

written  by  secondary  electron  emission  and  erased  by 
adding  electrons  to  the  crystal.  For  Pockets  effect 
crystals,  reversing  the  sign  of  the  image  surface 
charge  density  leads  to  contrast  reversed  images. 

In  the  linear  operating  mode,  the  incremental 
surface  charge  density  o(E)  deposited  on  the  crystal 
is  proportional  to  the  exposure  E. 


where  >i  is  the  quantum  efficiency  of  the 
photocathode,  e  is  the  electronic  charge,  O  is  the 
gain  of  the  MCF,  h  is  Planck's  constant  sad  v  is  the 
frequency  of  the  write  light  Additionally,  the 
induced  phase  change  A4  in  the  crystal  is 
proportional  to  *(E)  for  Pocket's  effect  crystals. 
The  exact  expression  depends  oa  the  type  aad  cut  of 
the  crystal  employed.  For  cxaasple,  in  oblique-cut 
LiNbO,  *•  the  electrically-iadueed  phase  retardation 
r  is  of  the  form 


r  -  *y. 


■V  •  t?c  [®e  V*  *•  r*’]  (3) 


where  h  is  the  waveleagth  of  the  exposing  light  C 
is  the  capacitance  per  unit  area  of  the  crystal,  e0 
aad  t(  arc  the  ordinary  aad  extraordinary  refractive 
indices  respectively,  and  r.<  aad  ry«  are  effective 
electro-optic  coefficients.  when  suen  a  crystal  is 
read  out  between  crossed  polariters,  the  trans¬ 
mittance  of  the  crystal  is  given  by 


T  •  ly/lj  *  sin*  (t /2) 

The  most  recent  standard  MSLMs  have  employed 
LiNbOj  as  the  electro-optic  crystal.  The  z-cut 
crystal  has  been  used  for  phase  modulation  and  an 
oblique  cut  for  intensity  modulation.  Prototype 
devices  employing  SO-um-thick  oblique-cut  LiNbO. 
crystals  have  exhibited  spatial  resolution  of 
approximately  10  cycles/mm  at  30%  contrast* 1 

Additionally,  the  internal  processing  operations 
achievable  with  the  staadard  MSLM  include  multiple- 
level  to  two-level  intensity  image  transformation, 
contrast  reversal,  construct  enhancement,  aad  binary 
level  iouge  processing  operations  such  as.  AND, 
NAND,  OR,  NOR,  XOR.  NXOR.  However,  when  the 
standard  device  is  operated  in  the  linear  mode  its 
gamma  is  about  2,  aad  this  value  is  too  low  for 
aoaiiaear  image  processing  applications  that  employ 
techniques  such  as  pulse  frequency  modulation. 
Further  details  of  the  principles  of  operation  of 
the  staadard  MSLM  can  be  found  elsewhere.1 1  1 

Fabry-Perot  MSLM 


The  Fabry-Perot  version  of  the  MSLM  employs  a 
crystal  that  function  as  aa  electro-optically 
tunable,  Fabry-Perot  etaloa  when  electrons  are 
deposited  or  removed  from  its  surface.  To 
fabricate  such  a  crystal  staadard  dielectric  mirrors 
are  first  deposited  oa  both  surfaces  of  the  crystal 
and  then  a  transparent  conducting  overcoat  it 

deposited  on  the  readout  surface  of  the  crystal 
The  phase  change  ♦  which  results  from  the 
electrically  induced  refractive  index  change  ha  it,' 
to  a  good  approximation,  proportional  to  the  surface 
charge  density  «(E)  at  the  crystal  surface  aad  to 
the  modulator  write  light  exposure  E_  [Sec  Eqs.  (2) 

and  (1)1. 

For  a  Fabry-Perot  etaloa  with  surfaces  of 

reflectivity  R.  it  is  well  known  that  the  ratio,  T, 
of  the  total  reflected  iateuity  to  the  iacideat 

iateasity  is  givea  by 


t  -  yi4 


4Esia*(f> 


(!-»*♦  4Rsia*(f) 


(5) 


Showa  in  Fig.  3  is  a  plot  of  T  vs  ♦  as  given  by  Eq. 
(3).  Note  that  the  reflected  readout  transmittance 
of  the  MSLM  approaches  zero  when  ♦  takes  oa  integer 
multiples  of  2ir  radians. 


Fig.  3.  Interferometric  readout  intensity  character¬ 
istic  of  a  Fabry-Perot  crystal  with  R  ■  10  % 
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ham  the  rc(ioa  A-B-C  o f  the  Fabry-Ferot 
characteristic  (Fig.  3)  clotcly  ipfndottti  the 
corresponding  region  of  the  desired  high-gamma 
charecteristic  (Fig.  I),  the  Fabry-Ferot  MSLM  will 
generate  the  high  gamma  characteristic  when  operated 
ia  the  clectroa  deposition  mode  with  grid  stabilised 
saturation.  The  device  is  initially  started  at  the 
poiat  A  (ON  state)  by  prechargiag  the  crystal  with  a 
uniform  surface  charge  density  oa.  This  is 
accomplished  by  flobdiag  the  photocathode  with  light 
and  setting  the  grid  voltage  to  a  valve  V0  *nch  that 
the  crystal  surface  saturates  at  the  corresponding 
surface  charge  density  o..  Then,  by  exposing  the 
photoeathodc  with  the  grid  voltage  set  at  V.,  the 
readout  light  follows  the  characteristic  ia  Fig.  3 
until  the  crystal  surface  voltage  reaches  Ve  with  a 
corresponding  charge  density  of  o_  Additional 
exposure  has  no  effect  oa  the  readout  light  because 
of  grid-limited  surface  charge  accumulation.  Thus, 
the  high-gamma  characteristic  of  Fig.  I  is  achieved. 

Herd-Clipped  Thresholding  Mode 

Both  the  standard  and  the  Fabry-Ferot  MSLMi  can 
be  operated  ia  the  hard-dipped  thresholding  mode  to 
achieve  high  gamma  operation.  To  operate  an  MSLM  in 
the  hard-dipped  thresholding  mode  with  the 
aegative-gamma  characteristic  shows  in  Fig.  1,  the 
device  is  initially  biased  in  the  ON  state  at  a  peak 
on  its  normal  (sin*  T/3)  readout  characteristic 
This  corresponds  to  the  point  A  on  Fig.  2.  Then, 
with  the  optical  input  image  incident  on  the 
photocathode,  Vh  is  ramped  downwards  at  a  pre¬ 
selected  rate  Vj,  that  establishes  the  desired 
threshold  exposure  E.h.  AU  exposures  below 
will  be  barely  recorded  because,  at  their  locations, 
electrons  cannot  be  removed  fast  enough  from  the 
crystal  to  prevent  the  gap  field  from  eventually 
repelling  ell  future  primary  electrons.  Thus,  all 
intensities  below  threshold  will  remain  ia  the  ON 
tutu. 

Because  the  slope  of  the  resulting  characteristic 
is  very  steep  between  threshold  and  saturation, 
virtually  all  write  light  intensities  above  thres¬ 
hold  are  written  to  the  maximum  charge  density  which 
can  be  set  by  the  terminal  value  of  Vw  to  coincide 
with  the  poiat  C  (OFF  state)  on  the  device  readout 
characteristic  Thus,  operation  in  the  nonlinear 
hard-clipped  thresholding  mode  leads  to  the  high- 
gamma  characteristic  of  Fig.  I.  Values  of  gamma  ia 
excess  of  10  can  be  easily  achieved  with  both  the 
standard  and  Fabry-Ferot  devices  using  this 

dclilqii. 

Optical  Feedback  Ceuflgnratlea 

Both  the  standard  and  the  Fabry-Ferot  MSLM  can  be 
operated  ia  the  optical  feedback  configuration  shown 
ia  Fig.  4  to  realise  high  gamma  operation.  The 
device  is  first  biased  at  the  poiat  A  on  its  readout 
characteristic  As  before,  this  is  accomplished  by 
operating  the  device  ia  the  open  loop  amdc  (shutter 
S  dosed),  flooding  the  photoeathodc  with  light  and 
adjusting  the  grid  voltage  such  that  the  crystal 
charges  to  the  uniform  surface  charge  deaslty 
The  image  to  be  processed  is  then  placed  in  the 
input  plane  F#  and  transferred  by  lent  L#  onto  the 
crystal  The  resulting  modulated  readout  signal  is 
then  rcimaged  vis  the  feedback  path  onto  the 
photoeathodc  of  the  MSLM.  The  processed  output 


iatage  is  detected  in  the  plane  P, 


Fig.  4.  Optical  feedback  configuration  for  high- 
gamma  operation  of  an  MSLM 


la  closed-loop  operation,  for  a  given  fixed 
uniform  exposure  E0  incident  on  the  input  image 
transparency,  the  high  transmittance  regions  of  the 
input  image  will  at  first  result  ia  strong  feedback 
to  the  photoeathodc  This  will  quickly  result  in 

the  deposition  of  a  surface  charge  density  «tK  on  the 
crystal  so  as  to  drive  the  traasatittance  of  the 
modulator  at  these  points  to  aero  (stable 

equilibriamji  Oa  the  other  hand,  at  the  low  . 
transmittance  regions  of  the  input  image  the 
feedback  will  be  weak.  This  will  result  in  low 
values  of  E_  that  will  deposit  only  very  small 
aamuats  of  additional  charge  on  the  crystsL  Since 
those  low  exposures  will  fall  below  E^,  the 

transmittance  of  the  modulator  will  remain  high. 

Because  the  MSLM  stares  these  charge  patterns,  this 
feedback  configuration  wilt  exhibit  the  high-gamma 
characteristic  shown  in  Fig.  I  when  read  out  with  a 
separate  uniform  sourer  Thu.  an  input  image  is 
transformed  into  a  halftone  image  by  this  feedback 
configuration. 

Preliminary  t emits 

A  vacuum-demountable  Fabry-Ferot  MSLM  was  con¬ 
structed  using  a  300-um-thick  LiNbO,  crystal  with 
mirror  reflectivities  of  approximately  30%  and  M% 
oa  the  insulating  and  conducting  terfaces,  respect¬ 
ively.  The  Insulating  mirror  consisted  of  a 
multiple  layer  dielectric  coating  of  SiOj  and  ZrO*. 
The  measured  readout  open-loop,  grid-controlled 
saturation  characteristic  of  the  device  is 
illustrated  ia  Fig  3. 


Fig.  3.  Measured  open  loop  Fabry-Ferot  readout 
characteristic  of  a  vacuum-demountable 

prototype  MSLM  with  crystal  surf  see 

reflectivities  of  30%  and  10%. 


Note  the  iapiovuMit  over  «kt  typical  iiu 
to  oo  red  characteristic  of  the  tttadard  MSLM. 
Because  of  the  unmatched  reflectivities,  the 
eoatrost  of  the  measured  readout  characteristic  it 
aot  optimum.  Nevertheless,  the  measured  open  loop 
gamma  of  this  prototype  Fabry-Perot  MSLM  it  6.2  ss 
compared  with  a  gamma  of  2  for  the  standard  MSLM 
operated  ia  the  liaear  mode,  dated  loop  gammas  are 
expected  to  he  much  higher. 


APPLICATIONS  TO  NONLINEAR  PROCESSING 

Pulae-Frequeacy  Medalatloa  Technique 

The  goal  of  thia  techaique  la  to  perform  inten¬ 
tly  to  spatial  frequency  coaveraioa  oa  the  iaput 
image  to  that  subsequent  Fourier-plane  spatial 
filteriag  results  ia  the  desired  aoaliaear 
operation.  The  codiag  or  asodulatioa  process  is 
geaerally  performed  through  the  use  of  a  contact 
screea.  COatact  screens  couaist  of  aa  array  of 
cells  with  one-  or  two-diaacasioBal  spatial-frequency 
aad  traaamittaace  variations  T„(x,y)  withia  each 
oelL*  Aa  example  of  the  traasmittaace  profile  of 
a  specific  one -dimensional  contact  screea  is  shown 
ia  Fig.  d* 1 

Image  modulation  is  accomplished  by  sandwiching 
the  original  image  sad  the  contact  screea  together 
aad  imaging  the  combined  transparency  onto  a  high- 
gamma  (infinite  to  be  ideal)  recording  medium  such 
as  the  above-described  high-gamma  MSLMs.  The 
frequency  of  the  contact  screea  moat  be  sufficiently 
high  so  that  withia  a  unit  cell  the  traasmittaace 
T_(x)  of  the  iaput  image  transparency  is  constant. 
Thus  upon  readout  of  the  high-gamma  recording  medium 
a  halftone  image  of  the  original  is  generated. 
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Fig.  d.  Traasmittaace  profile  of  the  unit  cell  of  a 
specific  one-dimensional  contact  screen 
Crossed-hatched  regions  are  opaque. 


The  modulated  halftone  image  is  then  fed  into  the 
iaput  plane  of  a  coherent  optical  processor.  Fig.  7, 
which  separates  the  various  density  levels  into 
specific  spatial  frequency  domains  withia  the 
Fourier  plane.  With  proper  design  of  the  screen, 
spatial  filtering  ia  the  Fourier  plane  can  be 
effectively  utilised  to  achieve  a  wide  range  of 
aoaliaear  image  aad  signal  processing  operations. 


Fig.  7.  Standard  coherent  processing  system. 

To  further  illustrate  the  concept  of  pulse- 
frequency  modulation,  consider  the  specific  case  of 
a  oac-dimcasioaal  contact  screea  with  the  unit  cell 
transmittance  pattern  TM(x)  that  is  illustrated  in 
Fig.  4  The  eait  cell  of  this  screea  consists  of 
eight  slits  with  four  different  transmission  levels, 
T,|  *  T_4 .  Given  a  source  of  constant  uniform 

intensity  I,,  it  follows  that  the  exposure  incident 
oa  the  iaput  transparency  is  given  by  E.  -  Lt. 
where  t  is  the  exposure  time.  Ignoring  diffraction 
losses,  the  exposure  Em  incident  oa  the  high-gamma 
modulator  due  to  the  typical  slit  withia  the  unit 
ceil  will  be  given  by 

*  ®oToTsa*  ■  •  2,  J.  4.  (6) 

where  a  is  a  label  denoting  slits  of  the  same 

traasmittaace,  aad  Tg.  the  local  traasmittaace  of 
the  iaput  image  transparency,  is  assumed  to  be 
constant  over  the  uait  celL  Note  that  for  the 

given  screea  E_a  >  Ew- . « 

Because  the  modulator  exhibits  the  threshold  - 

characteristic  illustrated  ia  Fig.  1,  the  spatial 
frequency  modulation  of  its  readout  light  will  be 

dependent  oa  the  exposure  E_r  For  example,  givea  a 
fixed  exposure  Eg  incident  oa  the  iaput 
transparency,  if  withia  a  givea  cell  T.  is  such  that 
Eae  <  Li.  then  all  E__  for  that  cell  will  be  below 
threshold,  aad  the  cell  will  have  a  uniform 
traasmittaace  of  nearly  unity.  Thus  the  modulator 

readout  light  from  that  .  cell  will  be  spatially 
unmodulated.  That  ia.  its  grating  carrier  spatial 
frequency  would  bo  aero  (f„  -  OX  Likewise,  if  T. 

«*  such  that  Em1  k  Etk  .  then  the  modulator 

readout  tight  from  that  cell  will  be  asodulated  by  a 
grating  with  spatial  frequency  f__  •  1/X.  For  E_.  k 
E^*  EmJ,  fj,  -  2/X.  -  aad  Tor  E^,  k  Etk,  ijj,  - 

When  this  pulse-frequency  modulated  image  is 
injected  into  the  conventional  coherent  optical 

processor,  the  diffraction  spot  at  spatial  frequency 
coordinate  f,  >  fX/X  ia  the  Fourier  plane  will 
contain  the  information  corresponding  to  points  in 
the  iaput  image  with  T.  governed  by  TM  Tn  k  I../I-  > 
TnTp.  Here  f  is  the  focal  length  of  the  Fourier 

transform  leas,  X  is  the  wavelength  of  the  readout 
source  aad  ftk  aad  l(  are  the  intensities  corres¬ 
ponding  to  Etk  aad  E0,  respectively.  Similarly,  the 
spot  at  f.  ■  CX2/X  contains  the  image  iaformatioa 
corresponding  to  T„  T#  k  Ith/I0  *  T„  T^  etc 

Several  experimeaa  can  then  be  performed.  For 
example,  by  measuring  the  intensities  of  the  spots 
in  the  Fourier  plane,  a  histogram  of  the  original 
image  caa  be  obtained.  Second,  if  different  neutral 
density  filters  that  have  higher  densities  for  the 

spectra  with  lower  intensities  are  placed  behind 

these  spots  and  all  other  diffraction  orders  are 
stopped,  the  output  image  contrast  will  be  enhanced. 
Third,  if  a  white  light  readout  source  is  used 

instead  of  a  moachromatic  source,  and  a  set  of  color 


filter*  are  placed  at  ike  Fourier  plane  to 

telectivcly  pan  certain  colon,  a  pseudo-color 
image  will  be  obtained.  Finally,  if  a  act  of 
optical  wedge*  with  different  wedge  angle*  are 

placed  behind  the  Fourier  plane  diffraction  spot*, 
artificial  ttcrco  pictures  will  be  obtained.  These 
are  just  a  few  of  the  nonlinear  processing 
operations  that  can  be  realized  with  this  technique. 
These  experiments  are  now  in  progress.  Future 
results  will  be  published  elsewhere. 
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Abstract 


In  this  paper,  an  inner-product  array  processor  for  the  associative  retrieval  problem 
is  presented.  First,  the  algorithm  and  architecture  of  the  array  processor  design  are 
discussed.  Then  an  optical  implementation  scheme  is  proposed.  The  matrix  model  of  the 
associative  memory  is  adopted.  In  this  model,  if  one  of  the  M  vectors  is  to  be  reliably 
recalled,  the  dimension  of  the  vectors,  N,  must  be  much  larger  than  M.  By  taking  advan¬ 
tage  of  this  fact,  our  result  offers  a  factor  of  /ff/TT  saving  on  the  matrix  elements. 

More  significantly,  real-time  inputting  and  updating  of  the  matrix  elements  can  be 
potentially  implemented  with  existing  space-variant  holographic  elements  and  recently 
discovered  liquid  crystal  television  spatial  light  modulators. 

I.  Introduction 


Optical  array  processors  have  a  great  potential  because  of  their  parallelism,  high 
computational  rates,  small  size  and  weight,  and  their  low  power  dissipation  and  cost. 

These  processors  naturally  offer  the  same  strength  of  VLSI  in  terms  of  massive  parallelism 
and  yet  circumvent  the  limitation  on  communication  inherent  in  VLSI  processors. 

In  this  paper,  we  discuss  an  optical  processor  design  for  an  associative  retrieval 
processing  system.  We  shall  first  present  a  brief  history  of  the  evolution  of  distributed 
associative  memory  networks,  and  the  essential  algorithmic  and  architectural  design 
considerations.  These  then  lead  to  a  unique  Optical  implementation  of  the  inner-product 
array  processor  for  the  associative-retrieval  problems.  There  are  two  memory  types  in  the 
current  computer  design;  one  is  location  addressable  and  the  other  is  content 
addressable.  It  has  been  recognised  that  the  content-addressable  type  is  more  closely 
related  to  how  the  human  brain  functions.  In  fact,  a  popular  approach  to  its 
implementation  is  based  on  one  which  resembles  that  of  a  neuro-network.  Neural  signals 
are  trains  of  pulses  with  variable  frequencies.  The  task  of  memory  is  to  reproduce  the 
neural  signal  at  the  places  where  they  earlier  occurred.  This  leads  to  the  notion  of 
associative  memory  network  and  associative  retrieval,  whose  main  features  Include 
recognition  and  error  correction  based  on  partial  or  cluttered  input. 

II.  A  Brief  Historical  Note 


Since  the  1970's,  the  correlation  matrix  model  of  the  distributed  associated  memory 
network  has  been  gaining  popularity.  Notably,  Kohonen,  Nakano,  and  Anderson  have  done 
Independent  work  in  thla  area  in  the  early  1970's.  A  brief  history  is  presented  below, 
and  key  references  are  provided  for  researchers  who  have  interests  in  more  details  of  the 
evolution  of  associative  memory  networks. 

Note  that  the  conception  of  associative  memory  can  trace  all  the  way  back  to 
Aristotle's  work  (370  B.C.)  on  memory  and  reminiscence.  The  cybernetic  research  work  in 
19S0's  on  learning  digital  neworks,  perceptron,  and  conditioned  connection  crossbars  (1-31 
has  paved  ways  for  the  modern  era  of  studies  on  the  subject.  In  the  1970's,  the  matrix 
model  (as  distinguished  from  the  connection  model)  of  memory  networks  seems  to  have  gained 
the  attentions  of  many  researchers.  These  work  are  represented  by  Morishlta  (4],  Kohonen 
(51,  Nakano  I*  '  ,  Anderson  (7).  More  recently,  Hopfield  (8)  further  extended  the  previous 
works  to  structure  a  computational  model  by  a  notion  of  energy  functions  with  an 
outer-product  computing  model  on  a  iterative  basis.  To  memorize  a  number  of,  say  M, 
M-tuple  vectors,  Hopfield  has  found  through  computer  simulations  that  a  vector  among  M  can 
be  successfully  recalled  if  M  is  less  than  0.15N. 


XIX.  An  inner-product  computing  modal  for  associativa  retrieval 

On*  of  th*  most  elementary  operations  implemented  by  associative  memory  is  the 
associative  recall  system.  While  Psaltis  and  Farah  (9,  10]  have  presented  the  optical 
implementation  of  associative  recall  model  based  on  th*  outer-product  of  th*  matrix,  we 
propose  a  model  that  is  based  on  th*  inner  product  of  the  matrix  with  an  array  of  M 
matrices.  Th*  dimensions  of  each  matrix  in  th*  array  are  /IT  x  /n  and  th*  array  is 
/Rx/fl.  We  assume  that  /R  and  /H  are  integers.  The  dimensions  of  the  array  are  /M  N  x 
/H  ' N  *  MN  which  is  less  than  the  dimensions  N  x  N  of  the  outer-product  matrix  model 
since  N  >  H. 

Referring  to  Figure  1,  the  iterative  computation  is  represented  by 
V*  < - Te  l AVI 
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Figure  1.  An  iterative  computing  model  for  associative  retrieval. 

where  A  is  a  N  x  N  associative-recalling  matrix,  which  is  assumed  to  be  "pre-taught” 

(i.e.,  non-adaptive) ,  and  Tgl"  I  is  a  thresholding  operation  with  threshold  *  8.  In 
th*  non-adaptive  case,  the  rank  of  A  is  always  equal  to  the  total  number  of  information 
patterns,  n.  If  the  columns  of  A,  representing  memorized  patterns,  are  nearly  orthogonal, 
then  a  pattern  may  be  retrieved  by  its  partial  information.  In  order  to  guarantee  a 
robust  and  reliable  information  retrieval,  M  should  be  much  smaller  than  the  total  number 
of  features,  N,  for  example  M  <  0.15  x  N.  This  implies  that  A  can  be  expressed  as 
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for  a  set  of  vectors  {u<,  v*};  i  «  1,...,M.  (Under  the  special  circumstance  of 
"auto-associative*'  recall,  then  U*  -  V*.) 

The  inner  product  array  processor  exploits  th*  fact  that  M<<N,  and  achieves  a 
considerable  amount  of  hardware  savings.  Th*  computation  in  Eq.  (1)  now  becomes 
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This  can  be  subsequently  decomposed  into  four  steps: 
T 


Step  (1)  X} 
Step  (2)  Yi 

Step  (3)  2 


utv  ,  for  i  »  1  ....  M; 
Xi  for  i  ■  1,...  M; 


Step  (4)  V*  -  T, 


The  four  separate  steps  of  this  new  computing  model  are  depicted  in  Figure  2. 

Referring  to  th*  schematic  diagram  in  Figure  2,  both  th*  I.P.O.  and  V.S.O.  may  be 
implemented  in  parallel  via  an  optical  array  processor.  In  this  case,  each  N-dlmensional 
I.P.O.  (or  V.S.O.)  may  be  implemented  by  on*  /TT  x  /FT  "optical-plane-product, "  as  shown 
in  Figure  3.  This  means  that  a  much  more  compact-size  optical  implementation  process  is 
now  possible. 

IV.  A  optical  implementation  of  a  programmable  associative  recall  system 
An  optical  system  for  implementing  the  inner-product  associative-retrieval  model  as 


I 
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Figure  2.  The  inner  product  computing  model  where  I.P.O.  represents  an  inner  proauct 
operator  and  V.S.O.  represents  a  vector  scaling  operation. 


(a)  (i-th)  I.P.O.,  1-1.  2 . M. 


Figure  3.  A  schematic  diagram  of  the  optical  implementation  of  I.P.O.  and  V.s.O. 

discussed  above  is  shown  in  Figure  4.  In  the  Figure,  a  liquid  crystal  television  (LCTV) 
is  used  as  an  electronically  addressed  spatial  light  modulator  (SLM).  In  fact,  other 
electronically  addressable  SLM's  such  as  the  Hughes  CCD-addressed  LCLV  may  also  be  able  to 
serve  the  same  function  as  the  LCTV.  Two  multiple-focus  holographic  lenses12  (hololens), 
MHLl  and  MHL2  are  used  as  space-var ient  optical  elements  for  performing  the  necessary 
inner-product  and  summation  functions.  The  function  or  capability  of  the  MHL's  is  shown 
in  Figure  5.  The  holographically-made  optical  element  is  capable  of  replicating  an  input 
2-D  image  by  first  focusing  it  to  an  array  of  focal  points  at  its  focal  plane  and  then 
forming  an  array  of  images  at  its  image  plane.  All  the  replicated  images  are  derived  from 
a  single  image  through  the  common  aperture  of  the  MHLj  a  capability  that  cannot  be 
achieved  by  any  currently  available  refractive  elements  such  as  a  glass  lens. 

To  set  up  the  optical  array  processing  system,  we  first  display  the  H  known  vectors  on 
the  LCTV  each  in  a  /S  by  matrix  format.  The  nature  of  the  LCTV's  transmissive 
screen  is  to  modulate  the  input  laser  light  by  what  is  being  written  according  to  the 
matrix-format  vector.  The  /M  x  /FT  matrices  being  written  or  displayed  on  the  LCTV 
screen  exhibit  its  storage  capacity  and  the  transmission  modulation  property  of  the  screen 
enable  these  matrices  to  be  multiplied  by  other  matrices.  Hence  once  the  writing  process 
is  completed,  the  storage  step  is  done. 

To  activate  the  addressing-recalling  mode  of  operation  of  the  system,  an  input  vector 
can  be  invoked.  The  N-tuple  vector  should  be  of  the  same  matrix  format  as  that  of  any  one 
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Figure  4.  A  schematic  diagram  of  an  optical  implementation  of  the  inner-product  array 
processor. 


Figure  5.  The  function  of  a  multiple-focus  holographic  lens. 

can  be  invoked.  The  N-tuple  vector  should  be  of  the  same  matrix  format  as  that  of  any  one 
of  the  M  vectors  so  that  it  can  be  written  onto  LCTVO.  The  screen  of  LCTVO  can  then  be 
used  to  modulate  the  collimated  laser  beam  through  the  cube  beam  splitter  BO.  The 
Information  being  written  on  LCTVO  can  then  be  sent  to  address  the  M  vectors.  After  the 


light  carrying  the  vector  information  transmitted  through  B1  and  MHL1 ,  it  is  replicated  to 

a  /H  by  /H  (here  we  assume  that  is  an  integer)  array  of  matrices  of  /U  x  /TT 

dimensions  of  elements  coinciding  matrix  by  matrix  with  what  has  been  previously  stored  in 
LCTV1 .  The  inner-product-type  operation  is  thus  partially  achieved  at  this  step.  To 
complete  the  entire  inner  product  process,  the  multiplied  results  are  followed  by  a 
diffuser  which  averages  the  light  intensity  and  yield  the  M  inner-product  scalars.  The 
scalars  are  then  transmitted  through  to  another  array  of  M  known  vectors  displayed  (or 
written)  on  LCTV2.  (Computationally,  this  process  implies  that  the  M  vectors  are 
multiplied  with  the  scalar.)  The  matrix  array  on  LCTV1  and  LCTV2  should  be  identical  in 
case  of  auto-associative  retrieval.  Finally,  the  weighted  vectors  (or  matrices)  are 
sumned  up  by  MHL2  which  plays  a  reversed  role  as  HHL1 .  A  TV  camera  or  CCD  detector  array 
can  be  used  to  detect  the  output.  The  output  should  be  thresholded  by  an  electronic 
device.  (The  thresholded  array  may  also  be  performed  by  an  optical  device  if  a  high-gamma 
spatial  light  modulator  is  available.)  If  the  electronic  device  is  adopted  (as  shown  in 
Figure  4),  the  thresholded  result  can  be  written  on  LCTV3  and  illuminated  by  a  collimated 

laser  light  from  BO.  This  thresholded  matrix  is  then  used  as  a  feed-back  input  through  B1 

and  MHL1  ready  for  a  new  iteration  process. 

The  above-mentioned  procedure  will  repeat  until  a  steady-state  is  reached  and  exhibited 
in  the  display  sent  also  through  B1 .  Once  the  steady-state  is  reached,  the  retrieval 
process  is  thus  completed. 

A  partial  optical  set-up  of  the  inner-product  associative-retrieval  model  is  shown  in 
Figure  6.  In  the  forefront,  a  LCTV  imbedded  in  a  liquid  gate  is  shown.  The  electric 
connection  to  the  LCTV  is  also  visible.  At  this  stage,  the  set-up  is  only  for  the  purpose 
of  testing  the  quality  of  the  LCTV  in  its  applications  as  a  spatial  light  modulator.  The 
results  of  the  testing  are  important  to  the  implementation  of  the  associative-retrieval 
model . 


Figure  6.  A  photograph  of  a  part  of  the  laboratory  set-up  of  the  optical  inner-product 
array  processor. 


V.  Conclusion* 


The  principle  and  implementation  of  a  programmable  associative  recall  system  based  on 
the  inner-product  model  have  been  described.  Advantages  of  the  system  include: 

1.  Tne  dimensions  of  the  matrix  in  the  computation  have  been  reduced.  For  example, 
in  the  Kohonen-Nakano-Hopf ield  model,  the  dimension  of  the  required  memory  matrix  is  N  x 
N.  Whereas  in  the  present  case  we  only  need  an  array  of  M  matrices  of  dimension  /TT  x 
/R.  Numerically,  if  N  *  100  and  M  ■  4,  then  a  2  x  2  array  of  10  x  10  matrices  is 
required  in  the  inner-product  model,  instead  of  a  100  x  100  memory  matrix.  If  N  *  900, 

N  -  100,  then  a  10  x  10  array  of  30  x  30  matrices  is  sufficient  to  perform  the  retrieval 
function.  Therefore,  one  order  of  magnitude  of  saving  on  the  memory  matrix  elements  can 
be  achieved  and  sake  the  optical  implementation  more  feasible. 

2.  The  optical  implementation  exploits  the  newly  developed  inexpensive  LCLV  as 
spatial  light  modulators  and  multifocus  lens  as  the  replicating,  holographic 
interconnecting,  and  matrix-matrix  multiplication  processors. 

3.  Real-time  modification  of  the  memory  can  be  achieved  by  changing  the  matrix 
elements  through  electronically  reprogramming  the  LCTVs. 

we  are  hopeful  that  the  proposed  inner-product  model,  once  realized,  will  be  very 
useful  for  many  associative  memory  applications. 
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